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(57) Abstract 

In a method and apparatus for analysing an elec- 
tronic image signal, the signal is treated as representing 
one or more cells each comprising a plurality of pixels. 
A set of pointers is generated and sequentially set ac- 
cording to characteristic values related to detailed im- 
age content The pointers are used to address a memory 
array and for successive frames, the vahie of an address 
in each array row indicated by the pointer correspond- 
ing to that row is updated. In this way, for each frame 
the characteristic values can be accumulated so that in z 
single operational mode, both a time history of the im- 
age, stored in a memory, is updated and an indication is 
produced indicative of the occurrence or non-occur- 
rence of an event not associated with image back- 
ground. The characteristic values can be generated by 
randomly or pseudo-randomly selecting pairs of pixels 
and for each, generating a binary signal depending on 
whether or not the intensity of incident light on a prede- 
termined one of the pair is greater than the intensity on 
the other. Over ail the rows, the values in the addresses 
being updated can be summed, as well as the maximum 
value in each row. The ratio of the two sums can be time 
weighted averaged with respect to the ratios obtained 
from previous frames. The ratio is compared with the 
average and the result used to determine the occurrence 
or non-occurrence of a significant event within the im- 
age. 
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IMAGE ANALYSER 

The present invention relates to a method of image 
analysis and an apparatus for carrying out the method. 
The invention is particularly, although not exclusively, 
suited to surveillance applications. 

US Patent 4 249 207 relates to a surveillance system in 
which an image received by a television camera is 
divided electronically into an array of cells or 
♦ tiles' . The tiles are dimensioned to allow for 
perspective, so that they each cover substantially the 
same area regardless of the particular part of the image 
to' which they respectively correspond. This is 
illustrated in Figure 1 of the accompanying drawings. 
The system monitors each cell to determine whether a 
potentially significant event is occurring in each 
cell. If such an event is detected in one cell, 
neighbouring cells are checked and if an event is 
occurring in, say two, of these, it is taken as 
indicative of a track of a moving person or object of 
interest. 

Occurrence of a potentially significant event in a cell 
is determined according to changes in the average light 
intensity received from that cell. Each cell consists 
of an array of pixels. These are analysed line by line 
and the integrated incident light intensity for that 
cell is computed. Over time, a weighted comparison is 
continuously made between the average present intensity 
and the average intensity in a previous frame. If the 
result of this comparison exceeds a predetermined, 
threshold, then that is taken as a potentially 
significant event occurring in that cell. 
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T he aforementioned OS Patent J^^ch 
provides good discrimination against false events sue 

suited to generally empty scenes sue* as the area 
between two perimeter fences sited in an open 

It is much less able to discriminate agarnst 
ir.Tents in a Busy scene, sue. as may occur in an 
urban environment- 

specific disadvantages of thishnovn 

a it is overly sensitive to certain small 

• fno imace e g. due to weather, changes, 
variations xn the image e.g. a. 

etc This leads to a large 

,0 <-««f?a tree movement, exc. 

ItTr'or false alarms resulting fro. normal changes in 



a scene; 
b 



b it has low sensitivity to certain large 
^tions in the image, eg. a small — 

change in part of a tile, uu- 
inrerast to be missed; and 

r large changes in the image desensitise the 
system for a while. « a result, a return to a normal 
cen will cause an activity alarm, and this reduce, the 
anility to track movement and identify the shape of 
%\ 2. since tiles vacated hy a slow object have the 
same activity as a tile hein, entered hy the ohject. 

OYTll , in why this existing system is 
The above problems explain wny txu- 

Tne auov * little variation in 

only effective in scenes with very 111= 

Lit levels. In fact it is only effective for 

light levels outdoor scen es where there 

monitoring indoor scenes ot between 

is no expectation of movement, e.g. dead .ones between 

fences surrounding a prison. 
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The present invention in its various aspects has a 
significant advantage over that described in the 
aforementioned OS patent in that it provides the ability 
to ' learn' the nature of a complex bacJcround. This 
enables it to discriminate better for genuine events of 
interest in an otherwise crowded or busy scene. 

Another previously known system called ' WISARD' is 
described by I. Aleksander et al in Sensor Review, July 
1984, pp 120-124. Pixels within a cell are interrogated 
pseudo-randomly. In the latter disclosure it is stated 
that the intensity of light incident on a pixel can be 
converted to a Grey-scale signal or alternatively, 
binary signal. 

In the latter case, the detected light level is compared 
with a threshold and a 1 or 0 is set according to 
whether the intensity is below the threshold or not. 
These binary signals are then combined into groups, 
which form pointers into an array stored in a random 
access memory (RAM). ' Each time an array element is 
addressed by a pointer, its value is set to "on- 
otherwise it is left unchanged. This process is carried 
out over a number of "frames". 

Thus, with WISARD, over successive frames, values in 
certain elements of the array become set. This is in 
effect a ' training period' . After sufficient frames 
have elapsed, the array is considered suitably primed 
and the system is put into run mode and pointers are 
generated in the same way. Then, if a pointer addresses 
an element which is set, this indicates that the 
intensities in pixels forming the pointer are similar to 
values which occurred in the training set. Pointers 
which address elements which are not set indicate that 
the situation is different from the training period. In 
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It will be apparent that WISARD can only compare the 
present situation with what happened during its finite 
' training' period and has no memory for events before or 
since. Also, transient events in the training period 
have as much effect as common events. As a result, 
WISARD cannot continuously improve its record of 
background, and so is limited in its ability to 
discriminate between significant events and the 
backround. 

The present invention is capable of continuously 
improving its record of the background and so can 
provide better discrimination than WISARD. 

A first aspect of the present invention provides a 
method of analysing an electronic image signal, the 
method comprising: - 

(a) processlng the image signal to regard it as 
representing one or more cells each comprising a 
plurality of pixels; 

(b) for consecutive frames of the monitored image, 
generating characteristic values according to the 
detailed content of the image; and 

(c) for consecutive image frames, accumulating the 
characteristic values so that in a single operational 
mode, both a time history of the image, stored in a 
memory, is updated and an indication is produced 
indicative of the occurence or non-occurence of an event 
not associated with image background. 

The first aspect of the invention also includes a device 
for analysing an electronic image signal, the device 
comprising electronic means for effecting steps (a)-(c) 
in the aforementioned method. 
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The present invention in general, mitigates the problems 
of the prior art referred to above and can extend the 
possibilities for scene monitoring to a wider variety of 
scenes. In particular, the invention is suited to 
monitoring scenes with a large amount of normal 
activity, for example to monitor busy street scenes to 
identify specific events. Examples of such events are: 

- arrival of an obstruction on a railway line, 

- arrival or departure of a vehicle through a gate, 

- arrival or departure of a person through a door, 

- occurence of congestion on a railway platform. 

Although in its widest definition, the first aspect of 
the invention requires only one cell, it is preferred 
that the image is represented as a plurality of cells, 
most preferably adjusted for perspective as hereinbefore 
described. 

A preferred method of generating the characteristic 
values is to randomly or pseudo-randomly select pairs of 
pixels and for each pair, generate a (preferably binary) 
signal in dependence upon whether or not the intensity 
of light incident on a predetermined one of the pair of 
pixels is greater than the intensity of light incident 
on the other. 

Thus, a second aspect of the present invention provides 
a method of analysing an electronic image signal, the 
method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a 
plurality of pixels; and 

(b) for consecutive frames of the monitored image, 
randomly or pseudo-randomly selecting pairs of pixels 
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in the cell or cells, as appropriate, and for each paxr, 
generating a binary signal in dependence upon whether or 
not the intensity of light incident on a predetermxned 
one of the pair of pixels is greater than the intensity 
of light incident on the other. 

The second aspect of the invention also includes a 
device for analysing an image signal, the device 
comorising electronic means for effecting steps (a) and 
(b) *of the method according to' the second aspect of the 
invention. 

Preferably at least one pair of pixels is so selected 
for each of a plurality of cells. It is also much 
preferred to select in the same way, a plurality of 
pixels for each cell of the image field. 

Once one or more pairs of pixels are selected in a given 
cell, the same pixels can then he used in subsequent 
frames until the end of the operating session. In a 
subsequent: session, the same pairs could be used again 
or different pairs selected for the remainder of that 
session. 

When a plurality of pixel pairs are used in a given 
cell it is possible for the same pixel to be used xn 
more than one pair, although this is not absolutely 
necessary. It is also possible, although not mandatory, 
for one or some of the pixels not to be used in any paxr. 

For different cells, the pair or pairs of pixels could 
be chosen at the same relative positions in each 
although again, this is not necessary. 

We also prefer utilising the characteristic values to 
generate pointers for addressing the memory containing 
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the time history of the image. A particularly 
advantageous means of doing this is to generate a set of 
pointers a ,...,a a , each of n binary bits and 
sequentially setting these bits according to the 
respective binary values of the signals resulting from 
the comparisons of the pixel pairs. In other words, 
pairs l,...,n of the pixel pairs are used to set the 
values of a (l,...,n) then pairs (n+l ),..., 2n are 
used to set a z (l, ...,n] and so on. 

Therefore, a third aspect of the present invention 
provides a method of analysing an electronic image 
signal, the method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a 
plurality of pixels; 

(b) for consecutive frames of the monitored image, 
generating characteristic values according to the 
detailed content of the image; and 

(c) generating a set of pointers a & , . . . , a m# 

each of n binary bits and sequentially setting these 
bits according to the characteristic values. 

The third aspect of the present invention also includes 
a device for analysing an image signal, the device 
comprising electronic means for effecting steps (a)-(c) 
of the methcd according to the third aspect of the 
invention. 

The values of n and m may be any convenient and may be 
the same or different, but n x m will be equal to the 
number of characteristic values. Therefore, in the 
context of the second aspect of the invention, n~x m 
will be equal to half the number of pixels selected in 
each cell. 
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in a preferred embodiment, these pointers are used to 
address a memory comprising an array of addresses 

comprising rows 1 « and columns t. . . . , 2 . When 

the characteristic values have been used to set the 
values of the pointers, the latter address the memory as 
follows. Pointer addresses row 1. The pointer 
contains a binary number of value somewhere between 0 
and 2 n . The pointer points to the column in row 1 
having a column number corresponding to the value xn 
a The value in that address is then incremented 
by 1 (at the outset, all addresses will be set to 
zer o). This is done for all rows up to m. In the next 
frame, the whole process is repeated, updating the value 
by 1 in a particular address pointed to in each row. 

Therefore, a fourth aspect of the present invention 
provides a method of analysing an electronic image 
signal, the method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a 

plurality of pixels; 

(b) for consecutive frames of the monitored image, 
generating a set of pointers each containing a value 
related to the detailed content of the image; and 

(c) using the pointers to address a memory array and 
for successive frames, updating the value of an address 
in each row of the array indicated by the pointer 
corresponding to that row. 

The fourth aspect of the present invention also includes 
a device for analysing an image signal, the device 
comprising electronic means for effecting steps (a)-(O 
of the method according to the fourth aspect of the 
invention. 

in a preferred embodiment, the set of pointers comprises 

n3 rii r>f n binarv bits and the 
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It will be appreciated that in terms of a memory array, 
the terms ' rows' and ' columns' are purely arbitrary and 
therefore may be transposed. 

A further advantageous feature of the invention is the 
way in which the values in the memory are used to 
discriminate between the background and unusual or 
unexpected occurences. In successive frames, for each 
row in the memory, the maximum- value at any address in 
the row is determined, the value currently pointed at 
also being known. For all the rows, the ratio of the 
sum of values in currently pointed to addresses, divided 
by the sum of the maxima is calculated. This ratio is 
compared with a time weighted average for the same ratio 
from previous frames. If this ratio is less than a 
chosen proportion of the time weighted average then it 
is taken as indicative of an unusual or unexpected event 
occuring in the relevant cell. 

Thus a fifth aspect of the present invention provides a 
method of analysing an electronic image signal, the 
method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a 
plurality of pixels; 

(b) for consecutive frames of the monitored image, 
updating one address in each row of a memory array in 
dependence on the detailed content of the image; and 

(c) over all the rows, summing the values in the 
addresses being updated and summing the maximum value in 
each row, subjecting the ratio of the two sums to a time 
weighted averaging with respect to the ratios obtained 
from previous frames, comparing the ratio with the time 
weighted average and using the result to determine the 
occurence or non-occurence of a significant event within 
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The fifth aspect of the present invention also includes 
a device for analysing an image signal, the device 
comprising electronic means for effecting steps UWO 
of the method according to the fifth aspect of the 
invent! on. 

When the present invention in any of its aspects is 
manifested as a device as opposed to a method, the 
device may be implemented as hardware /firmware arranged 
to operate under the control of appropriate software or 
it may be realised in terms only of hardware /firmware 
configured from logic gates, flip-flops etc, arranged to 
carry out the required functions. 

The invention will now be illustrated by way of the 
following description of a preferred embodiment and with 
reference to the accompanying drawings in which: - 

Figure 1 shows the arrangement of cell boundaries to 
take account of perspective; 

Figure 2 is a diagramatic representation of a device 
according to the present invention, for computing 
activity levels; 

Figure 3 is a block diagram of the hardware of the 
device shown in Figure 2; 

Figure 4 is a flowchart showing the logic applied to 
each cell to determine the existence or absence of a 
track; and 

Figure 5 shows the spatial relationship of local 
cells for movement from top right to bottom left. 
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Before describing the preferred embodiment in detail it 
is convenient first to define the following terms, thes 
definitions applying only to the described embodiment 
and not limiting the scope of the claimed invention: - 

Pixel 

A pixel (picture element) defines a grey level at a 
point in an image. Typically up to 256 grey levels are 
represented in 8 -bits. 

Image 

An image is an array of pixels, typically 512 x 512. 
Tile 

A tile (cell) is a subset of an image made up of N 
pixels. N must be even. The pixels in a tile are 
denoted: 

P ( , P N - 

Let M = N/2. 

Pixel Ordering 

The pixels are randomly ordered and divided into two 
halves: 

p 1 1 P , > • • • « Pfl' 



Pointer Generation 
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Generate 



bits b^b^b^,,...^ as: 



if p >q, then b 4 =0 else b^ 1, 

if ?X then b * = ° else V 1§ 

if PM XI M then b M = 0 else b M - I. 
Let m = M/n. 

Generate > n-bit binary addresses: 
a t = l**?, "V' 



a 



a characterise 
The » addresses a,,, a,, ... « _ poin ters 
the instantaneous image xn the txle and 



into 



the memory array defined below. 



Memory 



Memory is an a r z" array of data valu. 
information about the P»at history of the scan* . 
maY is continually updated as the proc.es proceed.. 

» addition, the aaxiau. value in each row 
maintained in an array -a,- The notatron i, that, 
-j = 1, ,m: 1 

n 

max..- maximum of Memory[j, ±1. i-L 

Address a. points to a cell in the ,th row of the 
memory. This cell is denoted: 



Memory[j,a^]. 
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Frame Rate 

Image frames are processed at a chosen rate, which will 
be application specific. The time at which the current 
frame is processed is denoted by t, and the time at 
which the previous frame was processed is denoted t-1. 



Parameters 

Parameters f, UpperLimit and k are selected to determine 
time constants over which a history is required. 

Threshold is a parameter which determines the detection 
sensitivity of the technique. 

The purpose of the mechanisms is to compute, for each 
tile, an activity level indicating if the image is in a 
normal state, 

# 

The mechanisms are implemented by the following means: 

a. a TV camera which captures images and outputs 
these images in a standard format, 

b. an Image Frame Grabber which captures the images 
at the frame rate of the camera, digitises each frame 
and stores it in a digital frame buffer, 

c. a Computer Processor which performs Pointer 
Generation by 

accessing the Image Frame Buffer and 
computing pointers into a Memory array, 

d. a Digital store, the Memory array, to accumulate 
statistics about Images, 

e. a Computer Processor which uses the pointers to 
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increment the Memory array (Memory Update), ^ 

£ a Computer Processor which accesses the Memory 
array to compute measures of Activity in the Image. 

T he computer Processors in c), •) and f) may be a single 
S^T- these activities may he distributed across 
several processors* 

Kunning the process is preceded by »* 
pixel orders. The choice and size of tiles 
application specific. at 
^en running, images are captured in the Frame Buffer at 
Z fraTrlte of the camera. The Computer Processors 
then carry out the following actions relating to each 
TaLTJysed. The Computation is described below and 
is carried out for each tile and the relationshxp 
tltweTthe separate processes is — ^ 
2 and the precise nature of the computer hardware 
shown in Figure 3. 

Pointer Generation 

Generate pointers into the Memory, as follows. 



. . . / A* 



For each j = 1# 

generate address a^ as described above. 

Memory Update 

Perform Memory Update to maintain a history of past 
images as follows: 

For each j - 1» . 

increment Memory [j.a^] by 1, and 

update max. to be the maximum element in the 

jth row of Memory. 
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If Memory [j^] > UpperLimit then scale the 
jth row of Memory, ie: 



Compute Memory 



[j,i] = f* Memory (j, i 1 , i = l,...,2 n , 



and compute max.. = f * maXj 



Image Assessment 



Perform Image Assessment to determine the current state 
of the image by computing a Score, to be compared 
against an Average Score. 

Sum the values Memory I j, a.j ], j = l,...,m, denoted 
Score. 

Sum the values max.., j = denoted Maximum. 

Calculate a value A t defining the instantaneous 
Activity in the image at time t iy computing: 
A fc = Score /Maximum, 

(Note: A t can take values between 0 and 1). 
Calculate the Average Activity in the image at time 
t by computing: 

Average t = k* Average^ + (l-k)*A t 
(Note: Average t can take values between 0 and 1). 
Calculate the measured Activity t at time t by: 
Activity t = (Average t - A t ) 

(Note: Activity t can take values between -1 and 1). 
If Activity t > Threshold then indicate that the 
Tile is Active. 

The overall technique described above derives a single 
value (Activity^) which indicates whether the current 
scene has changed from recent scenes. The time frame 
over which the change is being determined is specified 
by choice of the parameters f and k. For example; for a 
slowly varying background scene values of f and~k close 
to 1 could be used. Smaller values would be necessary 
where the background scene changes rapidly. 
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Unlike other previously known schemes, the technique xs 
sensitive to real changes to the scene and discriminates 
between these and typical acceptable changes to the 
scene. This is because the memory array remembers the 
characteristics of a normal scene. 

The calculation of the pointers as described above is 
very sensitive to local changes in a tile, but xs 
insensitive to global light changes in a tile. Each 
pointer causes a location in Memory to be incremented. 
Thus scenes which are common will cause certain Memory 
locations to be incremented frequently, whilst other 
locations will be incremented rarely. 

Whilst a scene is in a common state (note that the light 
levels may be changing significantly and the content of 
the scene may be changing) then the pointers will be 
addressing Memory locations containing large values. 
Then the derived values of Activity will be small or 
negative. 

However, when an unusual change occurs in the image, 
this will affect several pointers which will now address 
Memory locations containing low values. The resulting 
value of Activity will then be high (ie. close to 1). 

in this way, the technique immediately identifies 
changes in the image. A local change, caused for 
example by a person moving in the scene, may affect only 
a small number of pixels. Suppose, for example that ten 
pixels are affected, then because of the way the 
pointers are generated, this change will typically 
affect ten pointers. Thus a small local change will 
have a large affect on the Activity score. 
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Also, because of the way the Memory remembers past 
scenes, when the activity ends the computed Activity 
immediately reverts to a small value. In this way the 
presence or absence of an event in a tile can be 
monitored accurately. 

The result of the computations is to derive, for each 
image processed, an attribute Active, which can take the 
value true or false, for each tile. These Active values 
can be input to a process which determines the nature of 
an event in the scene. Such a process can track events 
and compute shape and size attributes of objects in the 
scene. The reliability of the claimed procedure for 
identifying active tiles, as opposed/to ambient light 
changes, makes it possible to perform Event Recognition 
successfully. 

In general, the number of pixels in a tile is 
application specific. The size of a tile will depend 
upon the size of object to be identified in the scene. 
Also, because of perspective, the number of pixels in 
each tile will vary. 

In the same way, the number of pixel pairs in a tile, M, 
is also application specific and tile specific. In 
general not all pixels in a tile need be considered and 
pixels can generally be undersampled. However, given 
the definition in the present preferred embodiment, M 
should be no smaller than 8. 

In order to exploit the 8-bit memory addressing of 
modern computers, n is generally selected as 8. Also, 
elements of Memory are typically 8-bit locations, and so 
OpperLimit would normally be chosen as 255. 
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Each tile is processed separately, and generates > 
pointers into the Memory array. In practice, more 
sensitivity can be gained by repeating the prxel 
generation a number of times to define more pointers. 
Typically three re-orderings of pixels are used, 
generating 3m pointers which implies a Memory array of 
3m x 2 n elements. 

The rate at which images are processed is typically 25 
frames per second. This could be less depending on the 
rate at which events occur in the scene. The mechanism 
incorporates flexibility so that the system can be 
implemented on a single computer or several computers 
depending on the frame rate required. 

The processing mechanisms previously defined show how 
each tile is assessed to see if it is Active. The 
determination of events in the scene can then be carrxed 
out by consideration of how the Activity values vary 
temporally and spatially. 

in contrast to other previously known schemes, the 
determination of events can be carried out successfully 
using simple logic based on Activity values Thxs xs 
because the claimed mechanisms reduce the false, alarm 
rate, i. e. the rate at which tiles are indicated as 
Active when they are not. 

The active values can be used to Track objects passing 
through the scene. In this case a tile has the 
additional attribute Track, which can take the value 
true or false, to indicate if an object is currently 
passing through that tile. 
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The logic applied to each tile is indicated in the 
Flowchart presented in Figure 4. The tests are applied 
at time step t based on the Active value at time t and 
the Track values at time t-1. 

Tracks in an arbitrary direction are determined by 
defining local tiles to be: 

a. all tiles contiguous to the tile of interest, 
including, 

b. the tile itself. 

To detect movement in a particular direction, -local 
tiles- is defined accordingly. For example as indicated 
in Figure 5 to track movement from the top right to the 
bottom left of a scene, local tiles would be chosen to 
be: 

a. contiguous tiles above and to the right of the 
tile of interest, and 

b. the tile itself. 

Tiles which have a Track value of true can be indicated 
on an image to show moving objects. Also, a combination 
of track direction can be used to detect objects which 
exhibit specific behaviour, e. g: 

a. movement down followed by across the image, 

b. an object moving in a specific direction and then 
pausing in the image (see below), 

c. an object moving through the scene and then 
passing through a door, or vice versa. 
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The Active and Track values can be used to detect 
objects which move into the scene and then stop. This 
s achieved by counting for each tile, the "nsecutxve 
frames for which the tile has a track value of true. 
The event is identified when this count passes a 
prescribed threshold. 

This process can identify, for example, a vehicle 
parkin, in a busy street, or * person loitenng in a 
busy walkway. 

various aspects of the present invention May also be 
embodied in the known «ISAto system hereinbefore 
Scribed. It will now be explained how WISAED can be 
so adapted. 

The original WISARD system involves generation of 
"LTrs into a binary memory array for a fixed perxod, 
i.e. , a fixed number of frames. The scheme is 
unsuccessful because: 

a it cannot adapt to changing scenes, and is 
therefore only applicable to fixed scenes, 

b it is very sensitive to certain small lxght . 
changes because of the way it replaces a grey 
scale image by a binary (black/white) image. 

Suitably modified, a combination of the WIS ABO Pointer 
Generation together with the Memory Update and Image 
Assessment of the present invention can ^be more 
effective. The following description xdentxfxes these 
locations in presenting a Pointer Generation scheme 
which can be very effective so long as the xmages 
processed have a large contrast (i.e. a wide range of 
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light levels). The notation is essentially the same as 
used hereinbefore and has the same meanings. 

Given a threshold T j# bits b , b^.., b N 
are generated as follows: 

If P >T then b =0 else b = 1, 

12 1 i 

if P >T then b =0 else b = 1, 

12 2 2 

• • • 

if Pj,>T 2 then b^O else b N =l.- 

Generate 1 n-bit binary addresses, where 1 = N/n 



a ={b b . . . b ], 

1 i j n* 

a = fb_ b A . . .b J, 

2 n+i n+2 in 



a l = l "* b N-i b N], 



pointing to an lx2 n memory array* 



This method of pointer generation is sensitive to choice 
of threshold T^. In particular, an object which is 
a similar grey level to the background may have no 
effect on the pointers. This deficiency can be reduced 
by maintaining a second lx2 n memory array and deriving a 
second set of pointers as follows: 



If T <P <T then b = 0 else b =1, 
if T <P <T then b ■ 0 else b =1, 

12 3 2 2 



if T <P M <T j then b N = 0 else b M = 1. 
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In the same way as above, a second set of 1 n-bit 

addresses are generated from this second set of bits 

b b ... t b N , which act as pointers into the 

second memory array. The Activity values derived from the 

two memory arrays are then averaged to give an accumulated 

Activity. 

Then if the threshold T^ T l# ^ are carefully 
chosen, a scheme based upon these pointers can also be 
successful.* 

The threshold must be chosen to accommodate to variation, 
in light level across the image. An effective way is to 
adjust them so that, across the whole image (i.e. across 
all the tiles): 

25% of pixel values are less than T^ 
25% of pixel values lie between T f and 
25% of pixel values lie between T z and T.^ 
25% of pixel values are greater than T^ 

Then T T and T s must be adjusted for every 
image which is processed. 

Clearly, this scheme could be extended to accommodate more 
light levels by introducing more thresholds. 
These Pointer Generation techniques are specific examples 
of a general process which generates bits b.. (taking the 
values 0 or 1) as a function of pixel pairs and 
parameters. Thus the examples given take the form: 

if p> g; then b = 0 else b = 1 
if p> T then b = 0 else b = 1 
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A further example is: 

if p > q ♦ epsilon then b = 0 else b = 1, 

where epsilon is a fixed parameter value determined by the 
level of noise present in the image (due to camera and 
transmission effects). 
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CLAIMS 



1. A method of analysing an electronic image signal, the 

method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored xmage, 
generating a set of pointers each containing a value 
related to the detailed content of the image; and 

(c) using the pointers to address a memory array and 
for successive frames, updating the value of an address xn 
each row of the array indicated by the pointer 
corresponding to that row. 

2. A method according to claim 1, wherein the set of 

pointers comprises pointers a t a B , each of^n 

binary bits and the memory array has m rows and 2 
columns. 

3 A method according to either preceding claim, further 
comprising over all the rows, summing the values in the 
addresses being updated and summing the maximum value xn 
each row, subjecting the ratio of the two sums to a txme 
weighted averaging with respect to the ratios obtained 
from previous frames, comparing the ratio with the txme 
weighted average and using the result to determine the 
occurrence or non-occurrence of a significant event withxn 
the image. 

4 A method according to claim 2, wherein the binary hits 
of the pointers are set in accordance with characteristic 
values generated for consecutive frames of the monitored 
image according to the detailed content of the image. 

5 A method according to claim 4, wherein the 
characteristic values are accumulated for consecutive 
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image frames so that in a single operational mode, both a 
time history of the image, stored in a memory, is updated 
and an indication is produced indicative of the occurrence 
or non-occurrence of an event not associated with image 
background. 

6. A method according to claim 4 or claim 5, wherein the 
characteristic values are generated by randomly or 
pseudo-randomly selecting pairs of pixels and for each 
pair, generating a signal in dependence upon whether or 
not the intensity of light incident on a predetermined one 
of the pair of pixels is greater than the Intensity of 
light incident on the other. 

7. A device for analysing an electronic image signal, the 
device comprising electronic means for: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored image, 
generating a set of pointers each containing a value 
related to the detailed content of the image; and 

(c) using the pointers to address a memory array and 
for successive frames, updating the value of an address in 
each row of the array indicated by the- pointer 
corresponding to that row. 

8. . A device according to claim 7, wherein said electronic 

means is adapted to generate said set of pointers as 

pointers a,, . a , each of n binary bits and the 

n 

memory array has m rows and 2 columns. 

9. A device according to claim 7 or claim 8, wherein said 
electronic means is adapted for, over all the rows, - 
summing the values in the addresses being updated and 
summing the maximum value in each row, subjecting the 
ratio of the two sums to a time weighted averaging with 
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respect to the ratios obtained from previous frames, 
comparing the ratio with the time weighted average and 
using the result to determine the occurrence or 
non-occurrence of a significant event within the image. 

10. A device according to claim 8, wherein said electronic 
means is adapted to set the binary bits of the pointers in 
accordance with characteristic values generated for 
consecutive frames of the monitored image according to the 
detailed content of the image. 

11. A device according to claim 10, wherein said 
electronic means is adapted to accumulate the 
characteristic values so that in a single operational 
mode, both a time history of the image, stored in a 
memory, is updated and an indication is produced 
indicative of the occurrence or non-occurrence of an event 
not associated with image background. 

12. A device according to claim 10 or claim 11, wherein 
said electronic means is adapted to generate the 
characteristic values by randomly or pseudo-randomly 
selecting pairs of pixels and for each pair, generating a 
signal in dependence upon whether or not the intensity of 
light incident on a predetermined one of the pair of 
pixels is greater than the intensity of light incident on 
the other. 

13. A device according to any of claims 8 to 12, wherein 
said electronic means comprises an image frame grabber, a 
memory and one or more computer processors. 

14. A method of analysing an electronic image signal, the 

method comprising: - 

(a)processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 
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(b) for consecutive frames of the monitored image / 
generating characteristic values according to the detailed 
content of the image; and 

(c) for consecutive image frames, accumulating the 
characteristic values so that in a single operational 
mode, both a time history of the image, stored in a 
memory, is updated and an indication is produced 
indicative of the occurrence or non-occurrence of an event 
not associated with image background. 

15. A method according to claim 14, wherein the image is 
represented as a plurality of cells. 

16. A method according to claim 15, wherein said plurality 
of cells is adjusted for perspective. 

17. A method according to any of claims 14 to 16, wherein 
the characteristic values are generated by randomly or 
pseudo-randomly selecting pairs of pixels and for each 
pair, generating a binary signal in dependence upon 
whether or not the intensity of light incident on a 
predetermined one of the pair of pixels is greater than 
the intensity of light incident on the other. 

18. A device for analysing an electronic .image signal, the 
device comprising electronic means for: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored image, 
generating characteristic values according to the detailed 
content of the image; and 

(c) for consecutive image frames, accumulating the 
characteristic values so that in a single operational 
mode, both a time history of the image, stored in a 
memory, is updated and an indication is produced 
indicative of the occurrence or non-occurrence of an event 
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not associated with image background. 

19. A device according to claim 18, wherein the image is 
represented as a plurality of cells. 

20. A device according to claim 19, where said electronic 
means is adapted to adjust said plurality of cells for 
perspective. 

21. A device according to any of claims 18 to 20, wherein 
said electronic means is adapted to generate the 
characteristic values by randomly or pseudo-randomly 
selecting pairs of pixels and for each pair, generating a 
binary signal in dependence upon whether or not the 
intensity of light incident on a predetermined one of the 
pair of pixels is greater than the intensity of light 
incident on the other. 

22. A device according to any of claims 18 to 21, wherein 
said electronic means comprises an image frame grabber, a 
memory and one or more computer processors. 

23. A method of analysing an electronic image signal, the 
method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 

of pixels; and 

(b) for consecutive frames of the monitored image, 
randomly or pseudo-randomly selecting pairs of pixels in 
the cell or cells, as appropriate, and for each pair, 
generating a binary signal in dependence upon whether or. 
not the intensity of light incident on a predetermined one 
of the pair of pixels is greater than the intensity of 
light incident on the other. 



24. A method according to claim 23, wherein in step (b), 
at least one pair of pixels is selected for each of a 
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plurality of cells. 

25. A method according to claim 24, wherein in step (b), a 
plurality of pixels is selected for each cell of the image 
field. 

26. A method according to any of claims 23 to 25, wherein 
the same pixels are used in each frame until the end of 
the operating session. 

27. A method according to any of claims 23 to 26, wherein 
the binary signals are used to generate pointers for 
addressing the memory containing the time history of the 
image. 

2ff. A method according to claim 27, wherein a set of 
pointers a 4 ,...,a n is generated, each of n binary 
bits and said bits are sequentially set according to the 
respective binary values of the signals resulting from the 
comparisons of the pixel pairs. 

29. A device for analysing an electronic image signal, the 
device comprising electronic means for: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; and 

(b) for consecutive frames of the monitored image, 
randomly or pseudo-randomly selecting pairs of pixels in 
the cell or cells, as appropriate, and for each pair, 
generating a binary signal in dependence upon whether or 
not the intensity of light incident on a predetermined one 
of the pair of pixels is greater than the intensity of 
light incident on the other. 

30. A device according to claim 29, wherein said 
electronic means is adapted to select at least one pair of 
pixels for each of a plurality of cells. 
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31. A device according to claim 29 or claim 30, wherein 
said electronic means is adapted to select a plurality of 
pixels for each cell of the image field. 

32. A device according to any of claims 29 to 31, wherein 
said electronic means is adapted to use the same pixels in 
each frame until the end of the operating session. 

33. A device according to any of claims 29 to 32, wherein 
said electronic means is adapted to use the binary signals 
to generate pointers for addressing the memory containing 
the time history of the image. 

34. A device according to claim 33, wherein saia 
electronic means is adapted to generate a set of pointers 
a a , each of n binary bits and sequentially to 

set these bits according to the respective binary values 
of the signals resulting from the comparisons of the pixel 
pairs. 

35. A device according to any of claims 29 to 34, wherein 
said electronic means comprises an image frame grabber, a 
memory and one or more computer processors. 

36. A method of analysing an electronic image signal, the 
method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored image, 
generating characteristic values according to the detailed 
content of the image; and 

(c) generating a set of pointers a i ,...,a -J1 each 

of n bits and sequentially setting these bits according to 
the characteristic values. 
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37. A method according to claim 36, wherein the pointers 
are used to address a memory array having m rows and 2 n 
columns, and the value of an address in each row indicated 
by the pointer corresponding to that row is updated, 

38. A device for analysing an electronic image signal, the 
device comprising electronic means for: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored image, 
generating characteristic values according to the detailed 
content of the image; and 

(c) generating a set of pointers a , ...,a , each 

i m 

of n bits and sequentially setting these bits according to 
the characteristic values. 

39. A device according to claim 38 / wherein the electronic 
means is adaprted to use the pointers to address a memory 
array having m rows and 2 n columns , and to update the 
value of an address in each row indicated by the pointer 
corresponding to that row. 

40. A device according to claim 38 or claim 3 9, wherein 
said electronic means comprises an image frame grabber, a 
memory and one or more computer processors. 

41. A method of analysing an electronic image signal, the 
method comprising: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored image, 
updating one address in each row of a memory array _in 
dependence on the detailed content of the image; and 

(c) over all the rows, summing the values in the 
addresses being updated and summing the maximum value in 
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each row, subjecting the ratio of the two sums to a time 
weighted averaging with respect to the ratios obtained 
from previous frames, comparing the ratio with the time 
weighted average and using the result to determine the 
occurrence or non-occurrence of a significant event within 
the image. 

42. A device for analysing an electronic image signal, the 
device comprising electronic means f or: - 

(a) processing the image signal to regard it as 
representing one or more cells each comprising a plurality 
of pixels; 

(b) for consecutive frames of the monitored image, 
updating one address in each row of a memory array in 
dependence on the detailed content of the image; and 

(c) over all the rows, summing the values in the 
addresses being updated and summing the maximum value in 
each row, subjecting the ratio of the two sums to a time 
weighted averaging with respect to the ratios obtained 
from previous frames, comparing the ratio with the time 
weighted average and using the result to determine the 
occurrence or non-occurrence of a significant event within 
the image. 

43. A device according to claim 42, wherein said 
electronic means comprises an image frame grabber, a 
memory and one or more computer processors. 
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